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Abstract 

Objective: To evaluate effectiveness, safety and cost-effectiveness of Computerised Clinical Decision Support (CCDS) for 
paramedics attending older people who fall. 

Design: Cluster trial randomised by paramedic; modelling. 

Setting: 13 ambulance stations in two UK emergency ambulance services. 

Participants: 42 of 409 eligible paramedics, who attended 779 older patients for a reported fall. 

Interventions: Intervention paramedics received CCDS on Tablet computers to guide patient care. Control paramedics 
provided care as usual. One service had already installed electronic data capture. 

Main Outcome Measures: Effectiveness: patients referred to falls service, patient reported quality of life and satisfaction, 
processes of care. 

Safety: Further emergency contacts or death within one month. 

Cost-Effectiveness: Costs and quality of life. We used findings from published Community Falls Prevention Trial to model 
cost-effectiveness. 

Results: 17 intervention paramedics used CCDS for 54 (12.4%) of 436 participants. They referred 42 (9.6%) to falls services, 
compared with 17 (5.0%) of 343 participants seen by 19 control paramedics [Odds ratio (OR) 2.04, 95% CI 1.12 to 3.72]. No 
adverse events were related to the intervention. Non-significant differences between groups included: subsequent 
emergency contacts (34.6% versus 29.1%; OR 1.27, 95% CI 0.93 to 1.72); quality of life (mean SF12 differences: MCS -0.74, 
95% CI -2.83 to +1.28; PCS -0.13, 95% CI -1.65 to +1.39) and non-conveyance (42.0% versus 36.7%; OR 1.13, 95% CI 0.84 
to 1.52). However ambulance job cycle time was 8.9 minutes longer for intervention patients (95% CI 2.3 to 15.3). Average 
net cost of implementing CCDS was £208 per patient with existing electronic data capture, and £308 without. Modelling 
estimated cost per quality-adjusted life-year at £15,000 with existing electronic data capture; and £22,200 without. 

Conclusions: Intervention paramedics referred twice as many participants to falls services with no difference in safety. CCDS 
is potentially cost-effective, especially with existing electronic data capture. 
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Introduction 

Demand for immediate care through emergency ambulance 
services has been steadily increasing in the UK and internationally 
over recent years [1]. However many callers have no clinical need 
for treatment or investigation at an Emergency Department [2]. 
Although health policy in the UK encourages emergency 
ambulance services to offer alternatives to such callers, there is 
little evidence about the effectiveness, safety or cost-effectiveness of 
clinical assessment by paramedics and triage to other care 
pathways. Computerised clinical decision support (CCDS) is 
effective in changing practice in other fields [3,4], but there is 
little evidence about its costs and benefits in emergency care [5] . 

Falls in older people are a growing problem as populations age 
[6] . One in three adults aged 65 or older falls each year [7] . In the 
UK the prevention of falls in older people is a priority [8] . Though 
prevention strategies are effective, [9]reducing falls depends on 
early identification of people at high risk, and delivery of 
interventions across traditional service boundaries [10], now 
advocated by national and international guidelines [11,12]. Calls 
to emergency ambulance services (999 calls) for falls contribute up 
to about 8% of the workload of Emergency Medical Services in 
the UK and internationally [13,14]. Some 40% of these patients 
do not go to hospital [15], though alternative pathways are often 
lacking. Although non-conveyance of patients attended by 
emergency ambulances is known to be risky [13,16,17], we know 
littie about how paramedics decide whether to convey. A US study 
recognised the pragmatic nature of the negotiation with patients 
whether to go to hospital [18]. In the UK qualitative studies have 
found that crew members base decisions on several factors 
including paramedic experience, training and intuition; time of 
call during shift; patient preference, home circumstances; and 
distance to receiving unit [19,20]. New pathways of care are now 
being developed for patients attended by emergency paramedics, 
for older people who fall, as well as other patients who may not 
need immediate care at an Emergency Department [21]. 

Evidence from trials in community and emergency settings 
suggests care offered by multi-disciplinary falls services improves 
outcomes for patients [22,23]. A recent Cochrane review of 19 
trials with 9500 participants estimated that falls services reduce 
falls by 24% (95% CI 14% to 33%) [9]. Hence we need to 
investigate how best to achieve appropriate triage by emergency 
paramedics of patients who have fallen. The aim of this trial was to 
test the effectiveness, safety (or avoidance of 'harm'), and cost- 
effectiveness of CCDS, a technological innovation for emergency 
paramedics to use in the care of older people who have fallen [24]. 
We use the term 'effectiveness' in reporting this pragmatic trial to 
indicate effects on processes and outcomes of care that are 
clinically important to patients or operationally important to 
service providers. Our principal outcomes reflect the mechanisms 
through which we theorised that this intervention could improve 
outcomes - through avoiding attendance at Emergency Depart- 
ments and referral to alternative community-based falls services. 



Materials and Methods 

The protocol for this trial and supporting CONSORT checklist 
are available as supporting information; see Checklist SI and 
Protocol SI. 

Ethics statement 

This cluster randomised trial was approved by the Multi-Centre 
Research Ethics Committee for Wales (08/MRE09/ 12), who 
sanctioned post-recruitment contact with a vulnerable population 
in an emergency setting, and inclusion of all patients who did not 
opt out of the study. Participants therefore did not have to give 
oral or written consent to participate in the trial during their 
emergency episode, but consented to follow up in response to 
information about the trial sent by participating ambulance 
services 7-10 days after their index event. Following processes 
agreed by the Ethics Committee, these services passed non- 
dissenting participants' contact details to the research team, and 
kept records of dissent in hard copy and electronically. Paramedics 
gave informed consent to participate. We registered the trial at: 
http://www.controUed-trials.com/ISRCTN10538608. 

Study design 

Cluster trials are appropriate to evaluate interventions targeted 
at health professionals. Thus Support and Assessment for Fall 
Emergency Referrals 1 (SAFER 1) was a cluster trial with 
paramedics as the unit of randomisation. [24] 

Setting 

We recruited patients at two UK study sites from November 
2009 until October 2010. Delays in implementing a national 
information technology programme [25] reduced these from three 
to two: Site one, an urban centre where we recruited paramedics 
from four ambulance stations; and Site two, where we recruited 
paramedics from nine stations across a mixed urban and rural 
area. 

Participants 

Paramedics were eligible to participate in SAFER 1 if they 
worked at any of 13 ambulance stations with a falls referral 
pathway in place; they continued to be eligible if they moved from 
one of these stations to another. In practice such a pathway 
requires a community-based falls service to accept direct referral of 
older people who fall by paramedics at the scene of their fall. 
Within an agreed space of time (typically within 1 week) falls 
services contact the patient and arrange a home visit to assess 
clinical and social needs and to arrange ongoing community based 
support [26]. The chief investigator invited all eligible paramedics 
to participate in SAFER 1 using local media to support 
recruitment. The trial team consented volunteers and passed 
anonymous details to the West Wales Organisation for Rigorous 
Trials in Health (WWORTH) for randomisation stratified by 
current ambulance station. Patients were eligible for SAFER 1 if 
they were: aged 65 or over; living in the catchment area of a 
participating falls service; and attended by a study paramedic 
following their first emergency call categorised by the call-taker as 
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Paramedics eligible to volunteer (n=409) 



LU 



Paramedics who did not volunteer (n=367) 



Paramedics randomly allocated (n=42) 



CCDS 



CONTROL 



Paramedics allocated to intervention (n=22): 
Received allocated intervention (n=17*) 
Did not receive intervention (n=5) 
i Withdrew (n=3) 

1 Unable to participate owing to illness (n=2) 
Eligible patients attended by paramedics 
who received allocated intervention (n=636) 



Paramedics allocated to control (n=20): 
Received allocated intervention (n=19) 
Did not receive intervention owing to illness 
(n=1) 

Eligible patients attended by paramedics 
who received allocated intervention (n=487) 



Paramedics lost to follow-up (n=0) 

Patients lost to follow up (n=200) 

Incorrect details (n=23) 

Not medically capable of responding (n=2) 

Patient refused contact (n=1) 

Patients refused consent (n=174) 



Paramedics lost to follow-up (n=0) 

Patients lost to follow up (n=144) 
Incorrect details (n=28) 
Not medically capable of responding (n=1 ) 
Patient contact details missing (n=2) 
Patients refused consent (n=113) 



CD 



Paramedic clusters analysed (n=17) 

Patients analysed (n=436) 
Average cluster size = 25.6 
Range of patients per cluster (8-49) 
Coefficient of variation = 42% 



Paramedic clusters analysed (n=18)*' 

Patients analysed (n=343) 
Average cluster size = 19.1 
Range of patients per cluster (1-47) 
Coefficient of variation = 57% 



*One of these paramedics received CCDS training but did not receive the computer 
**Two paramedics worked as a pair and were analysed as a single cluster 



Figure 1. Flow of paramedics and patients through the trial. 

doi:10.1371/journal.pone.0106436.g001 



a fall during the study period. We excluded those living in nursing 
homes as they were not eligible for care from participating falls 
services. 



Stage 4 
Stage 3 
Stage 2 | 
Stage 1 



Figure 2. Hierarchy of harms. 

doi:1 0.1 371 /journal.pone.01 06436.g002 



Emergency 
Admissions 



ED Attendances 



Interventions 

The health technology evaluated in the experimental arm was 
CCDS on hand-held Tablet computers for use by paramedics to 
decide whether to take patients who had fallen to an Emergency 
Department or leave them at home with referral to a community- 
based falls service. Site one implemented the CCDS simulta- 
neously with a system for electronic patient data capture; while 
Site two, where a different electronic data capture system was 
already in place, added CCDS software to the existing system. 
However neither site fully integrated CCDS with the electronic 
software; in particular Site one experienced many teething 
problems including loss of network signal and hardware failures. 
Control paramedics at both sites provided usual care, with paper- 
based protocols to assess patients and make decisions about then- 
care, including patients who had fallen. Usual care comprised 
assessment, treatment on scene as required and default convey- 
ance to the Emergency Department unless the patient refused to 
travel to hospital. Although we know that practice is variable, we 
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Table 1. NHS unit costs. 





Health Service Resource 


Unit cost (2009-10) 


Source 


Attendance by ambulance - conveyed 


£246 


NHS Reference Costs 


Attendance by ambulance - not conveyed 


£225 


NHS Reference Costs 


Attendance at Emergency Department 


£399 to £445 a 


NHS Reference Costs 


Inpatient stay per day 


£237 to £41 4 a 


NHS Reference Costs 


Referral to falls service 


£77 b 


NHS Reference Costs 



a Depending on level of treatment received 

b Derived from discussions with Age Concern; equivalent to the unit cost of referral to 'Hospital at Home or Early Discharge Schemes' 
doi:1 0.1 371 /journal.pone.01 06436.t001 



did not attempt to standardise care in the control arm as there is 
littie evidence about what is best for patients. Both groups could 
refer older people who had suffered a fall to community-based falls 
services. 

Outcomes 

Principal individual outcomes 

1 . Effectiveness - proportion of participants left at scene without 
conveyance to an Emergency Department and proportion 
referred to falls services 

2. Safety - proportion of participants with adverse events (harm) 
up to one month (999 call, Emergency Department attendance, 
emergency admission to hospital, or death); 

3. Cost-effectiveness - comparison of costs of implementation of 
CCDS for paramedics and its benefits in the form of patient 
utility modelled over 1 2 months. 



Secondary individual outcomes 

Self-reported falls; fall-related self-efficacy ('fear of falling') [27]; 
health-related quality of life (SF12) [28] and patient satisfaction 
(Quality of Care Monitor) [29] were gathered through postal 
questionnaires completed by patients or their carers. Operational 
indicators - ambulance service job cycle time, length of episode of 
emergency care and costs of care - were gathered from routine 
NHS sources. Though we had planned to include quality of 
clinical documentation, internal validation showed that the 
adoption of CCDS led to double data entry and risk of 



intervention bias. We explored implementation and adoption 
issues through focus groups and semi-structured interviews with 
practitioners, and reported the results elsewhere [30]. 

Sample size 

After redesigning SAFER 1 following delays in implementing 
the intervention, we powered it to detect clinically important 
changes in the proportion of participants who make another 
emergency call for a fall within a month (or die) - the 'safety' 
criterion. We calculated that a simple random sample of 622 
participants would yield 80% power when using a 5% significance 
level to detect a fall in that proportion from 30% to 20%. To 
adjust for clustering by the 42 paramedics recruited (rather than 
the 1 3 ambulance stations at which they worked), we assumed that 
the intra-paramedic correlation coefficient (IPCC) was 0.02, and 
applied Donner's formula [31] to yield a target sample size of 865, 
namely 42 paramedics each recruiting an average of 20.6 
participants or 622x[l+(20.6-l)x0.02]. 

Randomisation 

The West Wales Organisation for Rigorous Trials in Health 
(WWORTH) independently used random number tables to 
allocate paramedics, consented and stratified by current ambu- 
lance station, between intervention and control arms. It was 
possible to blind analysts to these allocations, but not paramedics 
or patients. 



Table 2. Characteristics of participants recruited to Intervention and Control groups. 



Characteristics of individual or cluster 




Intervention 


Control 






(n = 436) 


(n = 343) 


Men 




153 (35%) 


132 (39%) 


Women 




283 (65%) 


211 (61%) 


Median age in years (inter quartile range) 




83 (77-89) 


82 (76-88) 


Site 1 




235 (54%) 


225 (66%) 


Site 2 




201 (46%) 


1 1 8 (34%) 


Made index call out of hours (%) 




256 (59%) 


189 (55%) 


No of paramedics 




17 


19 


No of patients attended by paramedics 


Minimum 


8 


1 




Maximum 


49 


47 




Average 


25.6 


19.1 



doi:1 0.1 371 /journal.pone.01 06436.t002 
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Table 3. Questionnaire response rates. 





Intervention 




Control 




Total 




Site 1 


Site 2 


Site 1 


Site 2 




Eligible patients 


235 


201 


225 


118 


779 


Declined questionnaire follow up 


2 


10 


5 


16 


33 


Died 


11 


8 


9 


2 


30 


Questionnaire completed 


129 


117 


123 


65 


434 


Response rate 


58.1% 


63.9% 


58.3% 


65.0% 


60.6% 



doi:1 0.1 371 /journal.pone.01 06436.t003 



Patient recruitment and data retrieval 

Attending paramedics consented patients to treatment, but not 
trial participation owing to the emergency nature of the contact. 
Ambulance service staff identified potential participants from 
electronic records completed by control room staff, then 
confirmed eligibility from records completed by attending 
paramedics. They contacted participants by post within 10 days 
of the index call to give them the opportunity to opt out of follow 
up. At both sites we retrieved identifiable data about subsequent 
emergency calls and referrals to falls services and their outcomes 
from the ambulance services. Site one retrieved anonymised linked 
data about Emergency Department attendances, emergency 
hospital admissions and deaths from a central databank [32] 
although this process delayed analysis and reporting. At Site two 
we retrieved identifiable data about Emergency Department 
attendances and emergency admissions from individual National 
Health Service care providers; and about deaths from the Office of 
National Statistics. The flow of paramedics and patients through 
the trial is shown in Figure 1. 

Statistical methods 

In pre-specified analyses we used SPSS version 19 to fit multi- 
level logistic, linear and negative binomial regression models to, 
respectively, binary, measurement and count data available at one 
month on referrals to falls services, the hierarchy of 'harms' in 
Figure 2, and related outcomes, adjusting for statistically signifi- 
cant confounders, but not for multiple testing. Potential con- 
founders included: ambulance service (site); patient's age, gender 
and distance to nearest Emergency Department; date of recruit- 
ment and whether call was out of hours. For secondary outcomes 
we again used multi-level models, adjusted for significant 
confounders, and imputed missing data, by published rules when 
available. Specifically, missing responses to individual SF12 
questions were imputed using Expectation Maximisation methods 
[33] missing SF12-related scores were imputed using regression- 
based methods and set to zero on participant death. Similar 
regression-based methods impute missing Tear of falling' and 
participant satisfaction scores. 

To extend the outcomes of SAFER 1 to one year, we adopted a 
modelling approach similar to that used by Goitein to extend the 
outcomes of CT scans of gastric carcinoma to survival over time 
[34]. Specifically we inferred that participants referred to falls 
services in SAFER 1 would achieve the clinical outcomes reported 
for intervention participants with similar characteristics in the 
Community Falls Prevention Trial of referral to falls services [22]; 
and that participants not so referred would achieve the clinical 
outcomes reported for control participants with similar character- 
istics in the Community Falls Prevention Trial. In doing so we 
exploited the similarity of populations and outcomes between 



SAFER 1 and the Community Falls Prevention Trial, in particular 
by standardising by age and referral rates using Site two, where 
electronic data capture was already in use as the standard. 

Cost-effectiveness 

We undertook a cost-effectiveness analysis from the perspective 
of the UK NHS and personal social services and used quality of 
life measured by the SF12, referrals to falls services, 999 calls, 
Emergency Department attendances and inpatient stays as 
outcomes over the next 30 days. To extend our time horizon to 
one year, we integrated the effects of CCDS on referrals to falls 
services as estimated by SAFER 1 with the effects of referrals to 
falls services on events over one year, especially patient utilities, as 
estimated by the earlier trial [22]. We used probabilistic sensitivity 
analysis to assess the extent to which the intervention gave value 
for money relative to using the same resources elsewhere. We 
estimated the implementation costs of CCDS, taking account of 
whether electronic data capture was already in place. We 
estimated the costs of staff, equipment and consumables from 
the ambulance services with and without existing electronic data 
capture; and the costs of healthcare use by multiplying that use by 
published unit costs (Table 1). 

Deviations from protocol 

Deviations from the original study protocol: (1) We reduced 
paramedic training in consultation with participating ambulance 
services from two days to half a day including assessment of 
competence (2) We were unable to analyse some outcomes that 
varied between hospitals, for example categorisation of falls; we 
therefore analysed only the generic outcome 'emergency admis- 
sion to hospital' (3) To reduce questionnaire length and maximise 
response rates, we did not collect costs incurred by participants, 
not least because in the UK they do not contribute financially to 
care provided by the falls services. (4) We did not measure 
outcomes at six months as planned, owing to delays in 
implementing the intervention. 

Results 

Recruitment, participant flow and questionnaire 
response rates 

Eligible paramedics who volunteered for SAFER 1 numbered 
27 out of 47 (57%) in Site one and 15 out of 362 (4%) in Site two. 
We allocated 22 paramedics at random to the intervention arm 
and 20 to control (Figure 2). Five paramedics in the intervention 
arm did not receive the intervention and were excluded from 
analysis, together with one in the control arm. However 
paramedics in the control arm attended fewer patients owing to 
long-term sickness, particularly in Site two, resulting in the 
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Table 5. Annual cost of implementing CCDS. 





Cost category 


Cost component 


Description 


Unit cost 


Total cost 


Unit cost 


Total cost 








Site 1: CCDS & 
electronic data 
capture 


Site 1: CCDS & 
Electronic data 
capture 


Site 2: CCDS only 


Site 2: CCDS 
only 


Staff time 


Project manager 


50% time on project 


£26,000 


£13,000 


£26,000 


£13,000 




Training costs 


Training of 'trainers' and 
paramedics for 6 hours 


£12,355 


£12,355 


£12,355 


£12,355 




IT support 


One day per week 


£100 per day 


£5,000 


£100 per day 


£5,000 




Auditing 


Project set up 


£200 


£200 






Equipment 


12 hand held 
tablet PCs 


For computerised clinical 
decision support 


£3,850 per tablet 3 


£16,490 








12 printers 




£595 per printer 3 


£2,549 








12 chargers 




£25 per charger 3 


£107 








Adapt vehicles to 
electronic data capture 


Time to adapt vehicles 


£60 per hour 


£8,709 










Engineering fee 


£6.965 










SIM cards 




£38 per month 


£5,472 






Consumables 


Paper rolls 


For printers 


20 rolls/printer x£6 


£1,440 


20 rolls/printer x£6 


£1,440 




Software licence 






£396 




£396 


Other 


Plain Healthcare 


Technical support 




£9.950 






Total cost (436 
vehicles dispatched} 








£75,668 




£32,191 


Average cost per 
vehicle dispatched 








£174 




£74 



3 Assuming the 1 2 sets of tablets, printers and chargers need replacing every 3 years; and converted to annualised capital charges using annual discount rate of 3.5%. 
doi:1 0.1 371 /journal.pone.01 06436.t005 



recruitment of 343 controls compared with 436 in the intervention 
arm (Table 2). One intervention paramedic received training but 
no equipment; he remained in the intervention group for analysis 
by treatment allocated. We retrieved primary outcome data from 
routine sources for all 779 participants. Table 3 shows that 434 
(61%) of those who did not opt out or die responded to postal 
questionnaires. 

Principal effects up to one month - analysis by treatment 
allocated 

CCDS usage was much lower in Site one, where CCDS and 
electronic patient data capture were both new (5/235 participants 
= 2%), than in Site two, where electronic data capture was already 
in place (49/201 participants =24%). Patients attended by 
intervention paramedics were twice as likely to be referred to a 
falls service [42/436 (9.6%) compared with 17/343 (5.0%); OR 
2.04, 95% CI 1.12 to 3.72], an effect that was consistent between 
sites. Non-conveyance rate was higher in the intervention group, 
but not significantly so [183/436 (42.0%) compared with 126/343 
(36.7%); OR 1.13, 95% CI 0.84 to 1.52]. Table 4 shows that 
intervention and control groups did not differ across the hierarchy 
of outcomes (Figure 2); subsequent emergency healthcare contacts 
or death occurred in 155 of 436 intervention participants (35.6%) 
compared with 111 of 343 controls (32.4%) [OR 1.15, 95% CI 
0.85 to 1.56]. Furthermore there was no difference between 
groups in participant-reported outcome measures. 

Job cycle time for emergency ambulances was 8.9 minutes 
longer for intervention patients than for control patients (95% CI 
2.32 to 15.26), although the total emergency episode of care 
(including time in Emergency Departments when participant were 
conveyed) was 5.7 minutes shorter (95% CI —38.5 to 27.2). 



Table 5 shows the costs of implementing CCDS with and without 
electronic data capture in place. Table 6 shows (non-significant) 
differences in healthcare resource use by one month. As SAFER 1 
used SF12 to collect quality of life data over only 30 days, we 
exploited the earlier trial of referral to falls services [20] to 
extrapolate those findings beyond 30 days. This enabled us to use 
the EQ-5D (a standardised tool for measuring health outcomes) to 
estimate the utility gain due to the increase in referrals to the falls 
service as 0.0139 (95% CI -0.0361 to 0.0638). When we 
combined this with the incremental cost of £208 appropriate to 
existing electronic data capture software, (Table 7) the estimated 
cost per quality-adjusted life-year (QALY) was £14,964 (lower 
2.5% confidence bound £3260); when we combined it with the 
incremental cost of £308 in the absence of electronic data capture 
software, (Table 7) the estimated cost per QALY was £22,154 
(lower 2.5% confidence bound £4828). The UK National Institute 
of Health and Care Excellence (NICE) generally recommends that 
the UK National Health Service buy treatments that cost less than 
£20,000 to £30,000 to gain one QALY. The probabilities that our 
estimates fall below the NICE thresholds are 58% (existing 
software, below £20,000), 6 1 % (existing software, below £30,000), 
40% (no software, below £20,000) and 48% (no software, below 
£30,000) [35]. 

Patterns and effects of CCDS usage 

Individual intervention paramedics used CCDS between 0 and 
22 times. This 22 accounted for 47% of the cases attended by this 
paramedic. The use of CCDS increased the proportion of patients 
referred to falls services [12/54 (22.2%) compared with 30/382 
(7.9%); OR 3.35, 95% CI 1.60 to 7.04], and those not conveyed to 
the Emergency Department [35/54 (64.8%) compared with 126/ 
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343 (38.7%); OR 2.91, 95% CI 1.61 to 5.28] with no increase in 
harms [17/54 (31.5%) compared with 134/382 (35.1%); OR 0.85, 
95% CI 0.46 to 1.58] (Table 8). Job cycle time was 6.4 minutes 
longer in patients when CCDS was used [96.6 minutes compared 
with 90.2 minutes; 95% CI for difference 6.6 to 19.3 minutes] but 
the whole emergency episode was 113.8 minutes shorter [126.6 
minutes compared with 240.5 minutes; 95% CI for difference 45.6 
to 182.1 minutes] (Table 9). 



i- .— m 



Adverse events 

We initiated the procedure for investigating a Suspected 
Unexpected Serious Adverse Reaction (SUSAR) only once - 
following the death of a trial participant left at home by the 
attending crew with a referral to the falls service. The ambulance 
service principal investigator (RW) reported formally to the 
independent Data Monitoring and Ethics Committee and Trial 
Steering Committee that this incident occurred in the control arm 
of the trial and the chairs of the two committees agreed to take no 
further action. 



Data sharing 

Some participants gave informed consent for data sharing; their 
data are available from h.a.snooks@swansea.ac.uk. However 
information governance does not allow access to the unconsented 
patient data held in the Secure Anonymised Information Linkage 
databank. For the Community Falls Prevention Trial [22] the 
technical appendix, statistical code, and dataset are available from 
pip.logan@nottingham.ac.uk. The technical report of SAFER 1 is 
available at: www.ictri.port.ac.uk/projects2/reports/ 

H%20Snooks%20fmal%20report%20Nov%20201 l.pdf. 



t— r\i m 



Discussion 

Principal findings 

CCDS usage was low, but the proportion of patients referred to 
falls services was twice as high in the intervention group as in 
controls. We found no differences between intervention and 
control groups in subsequent 'harms', patient-reported quality of 
life, satisfaction or fear of falling at one month. Job cycle time was 
nine minutes longer for intervention patients. By integrating these 
findings with those of the randomised trial evaluating referral to 
community falls services in a similar population [22], we found 
that CCDS was potentially cost-effective when complementing an 
existing electronic data capture system. 



Strengths and limitations 

We conducted a systematic review of the use of computerised 
clinical decision support (CCDS) in the emergency care setting. 
Though this search led us to 20 primary studies or reviews of the 
effectiveness of CCDS, we identified no other study of CCDS in 
pre-hospital emergency care. Together these studies of the 
effectiveness of CCDS across many fields show positive effects 
on processes of care, including improved compliance with 
guidelines and reduced time between presentation of problem 
and the start of definitive care, but reports of low CCDS usage 
were common. 

Key strengths of this study lie in the rigorous conduct of a 
randomised trial across 13 representative ambulance stations and 
integration of findings with a second trial previously undertaken in 
four representative Primary Care Trusts [22]. SAFER 1 suffered 
from three main limitations: quality of operational data; 
foreshortening of data collection; and infrequent use of CCDS. 
First data on Emergency Department attendances, inpatient 
admissions and mortality were initially incomplete, owing to poor 
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recording of patient identifiable data during the initial episode, 
and difficulty in matching them to central registers. Fortunately 
the cumulative nature of our primary outcome, and the manual 
searching of 999 records for subsequent events, generated a 
primary outcome for all trial participants. Secondly implementa- 
tion of the randomised trial, known to be challenging in pre- 
hospital emergency care [36], was generally successful. However 
delays in implementing CCDS prevented collection of the planned 
six-month outcomes within the funded period. Hence the main 
patient outcome, at one month, addressed the safety of the 
intervention more than its clinical effectiveness. Falls services do 
not offer crisis intervention, but longer-term multi-disciplinary 
assessment and tailored care [10]; hence referral to these services is 
unlikely to yield benefits within a month. Thus the SAFER 1 trial 
reports best on harms following the index call, and referrals to falls 
services. Fortunately we were able to translate our findings on 
referrals into outcomes over 12 months by integrating them with 
those of the Community Falls Prevention Trial of referrals to falls 
services [22]. Though the populations and outcomes of the two 
integrated trials were similar, there is a danger that practical 
integration of CCDS and falls services would have proved more 
difficult in two distinct sites than integrating two data sets through 
computer modelling. Finally technical problems affected CCDS 
performance in Site one. Fortunately use was higher in Site two, 
where paramedics were already using the hardware to document 
patient care. Though recruiting 779 participants against a target of 
865 was another potential weakness, the actual intra-paramedic 
correlation coefficient of 0.017 (Table 4) was less than the 0.02 we 
had assumed, with the result that the power of SAFER 1 fell by less 
than 2%. 

Implications for policy, practice and research 

Though we were able to ameliorate the first two limitations, the 
fact that paramedics used CCDS for only one eighth of trial 
participants reduced its potential cost-effectiveness. Even so, 
increased referrals to falls services occurred more widely than in 
participants for whom CCDS was used, suggesting that this 
complex intervention affected practice generally, perhaps through 
learning from training or CCDS use. Decision-making is complex 
in pre-hospital emergency care. Although the trial called 
'Effectiveness of paramedic practitioners in attending 999 calls 
from elderly people in the community' reported effective changes 
in paramedic care [37], paramedic interventions have often found 
difficulty in changing practice [38]. There is evidence that crews 
use protocols to justify current practice rather than to inform 
decisions: they decide to leave the patient at home and then use 
the protocol to justify this decision [39]. Our qualitative data will 
enable us to explore these issues. Operational data showed that job 
cycle time increased for patients attended by intervention 
paramedics. Some of this increase may have been due to lack of 
familiarity or infrequent use. Other problems arose from the 
introduction at Site one of an entire electronic data capture 
system, known initially to increase time on scene [40] . Integration 
of electronic data capture and CCDS software may ameliorate 
these. Furthermore reduced length of episode in the intervention 
group suggests that avoided journeys and reduced time in the 
Emergency Department may offset the increased pre-hospital 
phase. Thus our findings show that CCDS could have an 
important role to play in the provision of safe and effective care 
for this frail but growing patient group. 

Given the infrequent use of CCDS in this trial, and the time 
needed to detect benefits of increased referrals to falls services, we 



did not expect changes in health outcomes within 30 days, the 
span of the SAFER 1 trial. However the finding that referrals to 
falls services doubled, the inference of positive health outcomes at 
one year from the previous trial, and the low cost of the 
intervention suggest that CCDS has the potential to become cost- 
effective in the pre-hospital management of falls. To confirm these 
early findings needs further research, especially with integrated 
software and longer term outcomes. 

Conclusion 

Computerisation of health records is advancing in the UK [41], 
and abroad [42]. Many ambulance services have implemented 
electronic data capture, linking dispatch information to records 
completed on scene by ambulance crews and ED records. Thus 
the main findings of SAFER 1 - that CCDS is safe, effective in 
referring older people who fall to community falls services and 
potentially cost effective - are encouraging. These preliminary 
findings lead us to recommend evaluating CCDS within an 
integrated system for the care of patients who fall or otherwise do 
not need immediate care at the Emergency Department. 
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